emergency vehicle
VLMLight: Safety-Critical Traffic Signal Control via Vision-Language Meta-Control and Dual-Branch Reasoning Architecture
Wang, Maonan, Chen, Yirong, Pang, Aoyu, Cai, Yuxin, Chen, Chung Shue, Kan, Yuheng, Pun, Man-On
Traffic signal control (TSC) is a core challenge in urban mobility, where real-time decisions must balance efficiency and safety. Existing methods - ranging from rule-based heuristics to reinforcement learning (RL) - often struggle to generalize to complex, dynamic, and safety-critical scenarios. We introduce VLMLight, a novel TSC framework that integrates vision-language meta-control with dual-branch reasoning. At the core of VLMLight is the first image-based traffic simulator that enables multi-view visual perception at intersections, allowing policies to reason over rich cues such as vehicle type, motion, and spatial density. A large language model (LLM) serves as a safety-prioritized meta-controller, selecting between a fast RL policy for routine traffic and a structured reasoning branch for critical cases. In the latter, multiple LLM agents collaborate to assess traffic phases, prioritize emergency vehicles, and verify rule compliance. Experiments show that VLMLight reduces waiting times for emergency vehicles by up to 65% over RL-only systems, while preserving real-time performance in standard conditions with less than 1% degradation. VLMLight offers a scalable, interpretable, and safety-aware solution for next-generation traffic signal control.
- Asia > China > Hong Kong (0.05)
- Asia > South Korea (0.04)
- Asia > China > Shanghai > Shanghai (0.04)
- (5 more...)
- Transportation > Infrastructure & Services (1.00)
- Transportation > Ground > Road (1.00)
ReGen: Generative Robot Simulation via Inverse Design
Nguyen, Phat, Wang, Tsun-Hsuan, Hong, Zhang-Wei, Aasi, Erfan, Silva, Andrew, Rosman, Guy, Karaman, Sertac, Rus, Daniela
Simulation plays a key role in scaling robot learning and validating policies, but constructing simulations remains a labor-intensive process. This paper introduces ReGen, a generative simulation framework that automates simulation design via inverse design. Given a robot's behavior -- such as a motion trajectory or an objective function -- and its textual description, ReGen infers plausible scenarios and environments that could have caused the behavior. ReGen leverages large language models to synthesize scenarios by expanding a directed graph that encodes cause-and-effect relationships, relevant entities, and their properties. This structured graph is then translated into a symbolic program, which configures and executes a robot simulation environment. Our framework supports (i) augmenting simulations based on ego-agent behaviors, (ii) controllable, counterfactual scenario generation, (iii) reasoning about agent cognition and mental states, and (iv) reasoning with distinct sensing modalities, such as braking due to faulty GPS signals. We demonstrate ReGen in autonomous driving and robot manipulation tasks, generating more diverse, complex simulated environments compared to existing simulations with high success rates, and enabling controllable generation for corner cases. This approach enhances the validation of robot policies and supports data or simulation augmentation, advancing scalable robot learning for improved generalization and robustness. We provide code and example videos at: https://regen-sim.github.io/
- Asia > Middle East > Republic of Türkiye > Karaman Province > Karaman (0.04)
- North America > United States > Pennsylvania > Philadelphia County > Philadelphia (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- Transportation > Ground > Road (1.00)
- Automobiles & Trucks (1.00)
- Government > Regional Government > North America Government > United States Government (0.46)
Multi-Agent Risks from Advanced AI
Hammond, Lewis, Chan, Alan, Clifton, Jesse, Hoelscher-Obermaier, Jason, Khan, Akbir, McLean, Euan, Smith, Chandler, Barfuss, Wolfram, Foerster, Jakob, Gavenčiak, Tomáš, Han, The Anh, Hughes, Edward, Kovařík, Vojtěch, Kulveit, Jan, Leibo, Joel Z., Oesterheld, Caspar, de Witt, Christian Schroeder, Shah, Nisarg, Wellman, Michael, Bova, Paolo, Cimpeanu, Theodor, Ezell, Carson, Feuillade-Montixi, Quentin, Franklin, Matija, Kran, Esben, Krawczuk, Igor, Lamparth, Max, Lauffer, Niklas, Meinke, Alexander, Motwani, Sumeet, Reuel, Anka, Conitzer, Vincent, Dennis, Michael, Gabriel, Iason, Gleave, Adam, Hadfield, Gillian, Haghtalab, Nika, Kasirzadeh, Atoosa, Krier, Sébastien, Larson, Kate, Lehman, Joel, Parkes, David C., Piliouras, Georgios, Rahwan, Iyad
The rapid development of advanced AI agents and the imminent deployment of many instances of these agents will give rise to multi-agent systems of unprecedented complexity. These systems pose novel and under-explored risks. In this report, we provide a structured taxonomy of these risks by identifying three key failure modes (miscoordination, conflict, and collusion) based on agents' incentives, as well as seven key risk factors (information asymmetries, network effects, selection pressures, destabilising dynamics, commitment problems, emergent agency, and multi-agent security) that can underpin them. We highlight several important instances of each risk, as well as promising directions to help mitigate them. By anchoring our analysis in a range of real-world examples and experimental evidence, we illustrate the distinct challenges posed by multi-agent systems and their implications for the safety, governance, and ethics of advanced AI.
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.14)
- Europe > Russia (0.14)
- Asia > Russia (0.14)
- (41 more...)
- Overview (1.00)
- Research Report > Promising Solution (0.92)
- Research Report > New Finding (0.92)
- Leisure & Entertainment > Games (1.00)
- Law > Statutes (1.00)
- Law Enforcement & Public Safety > Crime Prevention & Enforcement (1.00)
- (11 more...)
iLLM-TSC: Integration reinforcement learning and large language model for traffic signal control policy improvement
Pang, Aoyu, Wang, Maonan, Pun, Man-On, Chen, Chung Shue, Xiong, Xi
Urban congestion remains a critical challenge, with traffic signal control (TSC) emerging as a potent solution. TSC is often modeled as a Markov Decision Process problem and then solved using reinforcement learning (RL), which has proven effective. However, the existing RL-based TSC system often overlooks imperfect observations caused by degraded communication, such as packet loss, delays, and noise, as well as rare real-life events not included in the reward function, such as unconsidered emergency vehicles. To address these limitations, we introduce a novel integration framework that combines a large language model (LLM) with RL. This framework is designed to manage overlooked elements in the reward function and gaps in state information, thereby enhancing the policies of RL agents. In our approach, RL initially makes decisions based on observed data. Subsequently, LLMs evaluate these decisions to verify their reasonableness. If a decision is found to be unreasonable, it is adjusted accordingly. Additionally, this integration approach can be seamlessly integrated with existing RL-based TSC systems without necessitating modifications. Extensive testing confirms that our approach reduces the average waiting time by $17.5\%$ in degraded communication conditions as compared to traditional RL methods, underscoring its potential to advance practical RL applications in intelligent transportation systems. The related code can be found at \url{https://github.com/Traffic-Alpha/iLLM-TSC}.
- North America > United States (0.14)
- Asia > China > Shanghai > Shanghai (0.04)
- Asia > China > Hong Kong (0.04)
- (3 more...)
- Transportation > Infrastructure & Services (1.00)
- Transportation > Ground > Road (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Reinforcement Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.47)
LLM-Assisted Light: Leveraging Large Language Model Capabilities for Human-Mimetic Traffic Signal Control in Complex Urban Environments
Wang, Maonan, Pang, Aoyu, Kan, Yuheng, Pun, Man-On, Chen, Chung Shue, Huang, Bo
Traffic congestion in metropolitan areas presents a formidable challenge with far-reaching economic, environmental, and societal ramifications. Therefore, effective congestion management is imperative, with traffic signal control (TSC) systems being pivotal in this endeavor. Conventional TSC systems, designed upon rule-based algorithms or reinforcement learning (RL), frequently exhibit deficiencies in managing the complexities and variabilities of urban traffic flows, constrained by their limited capacity for adaptation to unfamiliar scenarios. In response to these limitations, this work introduces an innovative approach that integrates Large Language Models (LLMs) into TSC, harnessing their advanced reasoning and decision-making faculties. Specifically, a hybrid framework that augments LLMs with a suite of perception and decision-making tools is proposed, facilitating the interrogation of both the static and dynamic traffic information. This design places the LLM at the center of the decision-making process, combining external traffic data with established TSC methods. Moreover, a simulation platform is developed to corroborate the efficacy of the proposed framework. The findings from our simulations attest to the system's adeptness in adjusting to a multiplicity of traffic environments without the need for additional training. Notably, in cases of Sensor Outage (SO), our approach surpasses conventional RL-based systems by reducing the average waiting time by $20.4\%$. This research signifies a notable advance in TSC strategies and paves the way for the integration of LLMs into real-world, dynamic scenarios, highlighting their potential to revolutionize traffic management. The related code is available at https://github.com/Traffic-Alpha/LLM-Assisted-Light.
- North America > United States (0.14)
- Asia > China > Shanghai > Shanghai (0.06)
- Asia > China > Hong Kong (0.04)
- (3 more...)
- Research Report > Promising Solution (0.34)
- Overview > Innovation (0.34)
- Transportation > Infrastructure & Services (1.00)
- Transportation > Ground > Road (1.00)
Analysis of a Modular Autonomous Driving Architecture: The Top Submission to CARLA Leaderboard 2.0 Challenge
Zhang, Weize, Elmahgiubi, Mohammed, Rezaee, Kasra, Khamidehi, Behzad, Mirkhani, Hamidreza, Arasteh, Fazel, Li, Chunlin, Kaleem, Muhammad Ahsan, Corral-Soto, Eduardo R., Sharma, Dhruv, Cao, Tongtong
In this paper we present the architecture of the Kyber-E2E submission to the map track of CARLA Leaderboard 2.0 Autonomous Driving (AD) challenge 2023, which achieved first place. We employed a modular architecture for our solution consists of five main components: sensing, localization, perception, tracking/prediction, and planning/control. Our solution leverages state-of-the-art language-assisted perception models to help our planner perform more reliably in highly challenging traffic scenarios. We use open-source driving datasets in conjunction with Inverse Reinforcement Learning (IRL) to enhance the performance of our motion planner. We provide insight into our design choices and trade-offs made to achieve this solution. We also explore the impact of each component in the overall performance of our solution, with the intent of providing a guideline where allocation of resources can have the greatest impact.
Evacuation Management Framework towards Smart City-wide Intelligent Emergency Interactive Response System
Abraham, Anuj, Zhang, Yi, Prasad, Shitala
A smart city solution toward future 6G network deployment allows small and medium sized enterprises (SMEs), industry, and government entities to connect with the infrastructures and play a crucial role in enhancing emergency preparedness with advanced sensors. The objective of this work is to propose a set of coordinated technological solutions to transform an existing emergency response system into an intelligent interactive system, thereby improving the public services and the quality of life for residents at home, on road, in hospitals, transport hubs, etc. In this context, we consider a city wide view from three different application scenes that are closely related to peoples daily life, to optimize the actions taken at relevant departments. Therefore, using artificial intelligence (AI) and machine learning (ML) techniques to enable the next generation connected vehicle experiences, we specifically focus on accidents happening in indoor households, urban roads, and at large public facilities. This smart interactive response system will benefit from advanced sensor fusion and AI by formulating a real time dynamic model.
- North America > United States (0.14)
- Asia > Singapore (0.05)
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.05)
- (4 more...)
- Transportation > Infrastructure & Services (1.00)
- Transportation > Ground > Road (1.00)
- Health & Medicine (1.00)
- Information Technology > Artificial Intelligence > Machine Learning (1.00)
- Information Technology > Architecture > Real Time Systems (0.91)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Information Fusion (0.48)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (0.46)
San Francisco police back the fire chief's complaint about robotaxi interferring with first responders
San Francisco is in an uproar over robotaxis' persistent interference with firefighters, police officers and other emergency medical personnel. The city's fire chief called attention Thursday to the potentially dangerous encounters between driverless cabs and first responders, telling The Times in an interview that she was "fed up" with the incidents, which include driving into active emergency scenes and parking on a fire hose. Now San Francisco's police union has joined city officials in urging regulators to postpone a vote, scheduled for Thursday, on a measure that would allow Waymo, Cruise and other robotaxi companies to expand in San Francisco. "While we all applaud the advancements in technology, we must not be in such a rush that we forget the human element and the effects such technology unchecked can create dangerous situations," union President Tracy McCray said. As robotaxi companies plan to provide service in Los Angeles, San Francisco officials battle with state regulators over robotaxi safety.
- North America > United States > California > San Francisco County > San Francisco (1.00)
- North America > United States > California > Los Angeles County > Los Angeles (0.26)
- North America > United States > California > Los Angeles County > Santa Monica (0.05)
- Transportation > Ground > Road (1.00)
- Law Enforcement & Public Safety (1.00)
- Information Technology > Robotics & Automation (1.00)
- (2 more...)
US probes crash involving Tesla that hit student exiting school bus
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. U.S. road safety regulators have sent a team to investigate a crash involving a Tesla that may have been operating on a partially automated driving system when it struck a student who had just exited a school bus. The National Highway Traffic Safety Administration Friday that it will probe the March 15 crash in Halifax County, North Carolina, that injured a 17-year-old student. The State Highway Patrol said the driver of the 2022 Tesla Model Y, a 51-year-old male, failed to stop for the bus, which was displaying all of its activated warning devices.
- North America > United States > North Carolina > Halifax County (0.26)
- North America > United States > Colorado > Arapahoe County > Littleton (0.06)
- North America > United States > California > Contra Costa County (0.06)
- Transportation > Ground > Road (1.00)
- Government > Regional Government > North America Government > United States Government (0.53)
Investigation launched into complaints of Tesla steering wheels coming off mid-drive
US auto safety regulators have opened an investigation into Tesla's Model Y SUV after getting two complaints that the steering wheels can come off while being driven. The National Highway Traffic Safety Administration (NHTSA) says the investigation covers an estimated 120,000 vehicles from the 2023 model year. The agency says in both cases the Model Ys were delivered to customers with a missing bolt that holds the wheel to the steering column. A friction fit held the steering wheels on, but they separated when force was exerted while the SUVs were being driven. The agency says in documents posted on its website on Wednesday that both incidents happened while the SUVs had low mileage on them.
- Transportation > Ground > Road (1.00)
- Government > Regional Government > North America Government > United States Government (0.52)